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ABSTRACT 

A Study was made: (1) to determine whether children 
allowed tc choose the difficulty levels of their arithmetic problems 
in a Compater Assisted Instruction (CAI) task would show greater 
engagement in learning than children who were not given a choice, (2) 
to discover possible patterns in the choices made, and (3) to 
determine the relationship of locus of control (LOC) attributions to 
engagement in the task. The subjects were 4th and 5th grade students, 
mostly Mexican-Americans, in a low-income school. Pairs of subjects 
were matched on age, sex, and initial achievement level in math. 
Subjects in both conditions used a modified form of the Math Drill 
and Practice program by Suppes, et al, 1974. Task specific attention 
or inatten-.ion and locus of control were measured. Among the major 
finds were: (1) that the choice group was significantly higher in 
engagement, (2) for both groups, engagement decreased significantly 
over a 15 day period; and (3) distinctive choice patterns did occur. 
The findings also showed that children will choose problems that 
result in poor academic performance; if performance in choice 
situations is to be improved, training methods that use information 
about children's unique patterns of choices should be designed. 
(Author/WCH) 
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Introductory Statement 

The Center's mission is to improve teaching in American schools. 
Its work is carried out through five programs: 

Teaching Effectiveness 

The Environment for Teaching 

Teaching Students from Low-Income Areas 

Teaching and Linguistic Pluralism 

Exploratory and Related Studies 

This Technical Report represents part of the work of the program 
on Teaching Students from Low-Income Areas. 
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Abstract 



The purposes of this study were (a) to determine whether children 
who were allowed to choose the difficulty levels of their arithmetic 
problems in a CAI task would show greater engagement in learning than 
children who were not given a choice, (b) to discover possible patterns 
m the choices made, and (c) to deteirmine the relationship of locus of 
. ntrol (LOC) attributions to engagement in the task. The subjects 
wee fourth- and fifth-grade students, mostly Mexican-Americans , in a 
low-income school. Thirty-eight subjects were assigned to either a 
choice or a yoked control condition. Pairs of subjects were matched on 
age, sex, and initial achievement level (lAL) in math. The choice condi- 
tion allowed the students to select problems at whatever level of diffi- 
culty they wanted; the yoked control condition presented the students 
with problems at preselected difficulty levels. Subjects in both condi- 
tions used a modified form of the Math Drill and Practice program, 1974, 
by Suppes, Searle, and Lorton. 

Each subjec" participated in 15 CAI sessions. Task-specific atten- 
tion or inattention was measured by an engagement/disengagement observa- 
tion instrument used by observers during every CAI session to record 
the behavioral responses of each subject. A 28-item LOC measure with 
four dimensions (stable/unstable, control/no control, internal/external, 
and self/other) was administered three times to all subjects. 

The major findings were as follows: (a) tne choice group was sig- 
nificantly higher in engagement than the yoked control group; (b) for 
both groups engagement decreased significantly and disengagement in- 
creased significantly over the 15 days of the study; (c) a linear rela- 
tionship was found between the difficulty levels of the problems worked 
by the choice group and the engagement levels of that group, i.e., the 
highest engagement levels were associated with the easiest problems and 
the lowest engagement levels were associated with the most difficult 
ones; (d) distinctive choice patterns ("maximizing" and "minimizing" 
patterns) did occur; (e) Maximizers chose problems below their lAL and 
had a high level of success in solving them,, whereas Minimizers chose 
problems above their lAL and had a low level of success; (f) significant 
differences found between the choice and yoked control groups on three 
out of four LOC dimensions indicated that the choice condition produced 
more positive attributions; and (g) no significant correlations occurred 
in the choice group between LOC attributions and engagement, and only 
one such correlation was found in the yoked control group. 

These findings show that children wjll choose piroblems that result 
in poor academic performance. It appears that if performance in choice 
situations is to be improved, training methods that use information 
about children's unique patterns of choices should be designed. 
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STUDENT CONTROL AND CHOICE: THEIR EFFECTS ON STUDENT 
ENGAGEMENT IN A CAI ARITHMETIC TASK IN A 
LOW-INCOME SCHOOL 



Maurice D. Fisher, Laird R. Blackwell, 
Angela B. Garcia, and Jennifer C. Greene 

Introduction 

The initial purpose of this study was to identify curriculum diffi- 
culty levels associated with high and low levels of student engagement 
and disengagement in a computer-assisted instruction (CAI) task. The 
term engagement is used in this report to refer to positive behavioral 
indicators of student attention to the experimental task. Disengagement 
refers to behavioral indicators of inattention or nontask behavior. 

After preliminary results from pilot data were analyzed, choice of 
difficulty level and perception of control were included as variables 
in the design. The study then focused on (a) the effects of difficulty 
level and choice of difficulty level on the engagement of students work- 
ing CAI math problems, (b) po£.sible patterns of student choices, and (c) 
the relationship of locus of control measures to choice of difficulty 
levels and engagement levels. 

Difficulty Levels 

The selection of CAI materials was complicated by the general lack 
of empirically validated criteria for selecting ranges of difficulty 
levels in curriculum programs. The program finally selected was the 
highly structured Math Drill and Practice program developed by Suppes, 
Searle, and Lorton (1974). The program presents basic arithmetic 
skills organized into fourteen types of problems (strands). Each 
strand contains problems labeled with grade levels that range from 1*0 
to 7.5, approximations of the positions of similar problems in popular 
elementary mathematics curriculum sequences* The grade levels assigned 
to problems in the Math Drill and Practice program thus became the 
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indicators of difficulty level for the present study* 
Choice 

The choice variable was operationalized by allowing some students 
in the sample to select their own problems from the CAI program and to 
decide, within limits, how long they would work with the computer. The 
as-:tumption for the self-selection procedure was that children would 
choose problems with difficulty levels that produced optimal environ- 
mental stimulation (Berlyne, 1960; Fiske & Maddie, 1961). Hunt (1961) 
has said that those problems which are optimally stimulating will pro- 
duce the correct match between a child's understanding and the diffi- 
culty levels of the curriculum. He also has argued that the Montessori 
method is effective simply because it allows children to choose problems 
to match their current state of knowledge and their level of intrinsic 
motivation, t'ms solving the "problem of the match" (Huat, 1964). 

Introducing choice in this manner made it possible to identify the 
self-selected difficulty levels that were related to the highest engage- 
ment levels. On the basis of Hunt's statements about the matching pro- 
cess (1961» 1964), it was predicted that students would initially 
choose problems with grade level designations similar to their current 
achievement grade levels, and would then choose more difficult levels 
later in the task. It ^as therefore hypothesized that children would 
use choice strategies to optimize their learning — for example, gradu- 
ally selecting more difficult problems and correctly responding to a 
relatively high percentage of these problems. Such a choice fc;trategy 
might be expected to yield feelings of success in working "hard" arith- 
metic problems and hence lead to improved engagement and academic sta- 
tus. The strategy would be reflected on the computer program by the 
choice of more difficult problems following a high percentage of cor- 
rect Responses and by the choice of easier problems following a low 
percentage of correct responses. A student who used this strategy 
might substantially improve his arithmetic achievement level and also 
maintain high levels of engagement. 

In addition to prov:ding a means for identifying highly engaging 
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arithmetic difficulty levels, this study also permitted determination 
of whether the choice variable per se was associated with high engage- 
ment levels. 

Student choice is an important feature of the current interest in 
open education models as a method of improving student motivation and 
performance (Heain, Burdin, & Katz, 1972; Silberman, 1970). There is 
some evidence that educational settings in which students control 
their classroom goals and activities increase motivation to solve aca- 
demic problems (Alschuler, 1969). The choice condition in this study 
simulated one aspect of the open school setting — the selection of cur- 
riculum difficulty levels. The effect of choice on engagement levels 
in this study was determined by comparisons between subjects who chose 
difficulty levels of problems and others who were required to work 
problems at the same difficulty levels. If engagement is viewed as a 
behavioral indicator of motivation, the results here are directly appli 
cable to open education models. 

Perception of Control 

Student choice can affect another important subject variable — the 
source to which students attribute responsibility for their performance 
in academic situations. De Charms (1972) found that students in class- 
rooms that present opportunities for making choices were likely to be- 
lieve that they, rather than the teacher or other external source, had 
control of their learning. 

The term locus of control is used here to refer to factors which 

the student sees as responsible for his performance in a learning task. 

A Locus of Control measure (LOC) was constructed for this study; it con 

talned four dimensions of attribution of outcome in the learning task. 

In addition to the usual dimension of internal/external attributions, 

a stable/unstable dimension and a control/no control dimension were 

included. A self/other dimension, which was unique to this study, was 

i 

also examined. The measure is in Appendix F. 
Experimental Questions 

The current interest in applying open education models to low- 

O 
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income area schools (Silberinan, 1970) should elicit research to investi- 
gate how these settings affect student motivation and engagement. Re- 
searchers have stated that "disadvantaged" children can learn more ef- 
fectively in classrooms where independent activities are encouraged 
(Hunt, 1967; Kohiberg, 1968). Although Hunt and Kohlberg concentrated 
on how the Montessori method increased intrinsic motivation and atten- 
tion among preschool children, other choice situations at higher grade 
levels might also produce improvement. The present investigation of 
locus of control attributions, choice variables, and their effects on 
engagement may be particularly important for understanding the effects 
of open education models on students in low- income area schools. 

Five questions were designed to determine the relationships be- 
tween student choice, problem difficulty levels, locus of control 
attributions, and engagement. 

1. Does the opportunity to choose difficulty levels of arithmetic 
problems increase engagement and decrease disengagement for 
subjects on a CAI task? 

2. Is engagement highest when subjects choose difficulty levels 
that match their initial achievement levels and lowest when 
they select difficulty levels that are most different? 

3. Do identifiable choice patterns emerge ^rom the selections of 
subjects In a CAI task? 

4. Does giving subject^> a choice of difficulty levels affect the 
locus of control attributions they make? 

5. Is there a correlation between the locus of control attribu- 
tions and the en^jagement or disengagement of subjects on a 
CAI task? 

DesigiA 

Two groups of 19 subjects were selected from fourth- and fifth- 
grade students with no previous CAI experience. The first group 
(choice group) was randorcly selected; subjects for the second group 
(yoked control group) were selected to form pairs matched on age, sex, 
and initial achievement level in math with the choice group subjects. 
The computer program was modified so that choice group subjects were 
allowed to request problems that were harder, easier, or the same 
level of difficulty during the CAI lessons. Problems for subjects in 
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the voked control group were tied to the difficulty levels chosen by 
their choice group counterparts. All subjects worked on the computer 
a raaxlmum of 35 minutes per day for 15 days. Observers recordcjc*. 
engagement and disengageK.ent levels for individual students in ten- 
second intervals on an Engagement/Disengagement Observation Instrument 
designed for this study (see Appendix D). The Locus of Control mea- 
sure was administered to each subject before the third and eighth day 
on the computer and during a follow-up interview at the completion of 
the series. 

Methods 

The Sample 

This research was conducted at an elementary school in California. 
The district administration considered the attendance area surrounding 
the school to be low-income, and the school received Title I funds 
which were applied to maintaining a separate building for language 
arts instruction. Grade levels at the school ranged from first through 
fifth. Approximately 90 percent of the students in these grades were 
from Mexican-American families. 

Contact with the principal and teachers began in the fall of 1971 
when the research staff met with them to describe plans for the study. 
As a result of this meeting, the research was permitted, and an infor- 
mal contract specifying conditions of reciprocity between the school 
and research staffs was drawn up (Appendix A). During 1972 a computer 
program that would be responsive to the students' choices was devel- 
oped, and the experimental procedures to be used in the study were de- 
signed. The study was conducted between January and June 1973 

Subjects ror the study were selected from three fifth-grade and 
two mixed fourth- and fifth-grade classes. Nineteen students were 
randomly selected to form the choice group from a pool of 100 who had 
no previous CAI experience. A matching procedure was then used to 
select 19 more students from the pool for the yoked control group. 
Each subject in the yoked control group was matched to a subject in 
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the choice group on sex, age, initial achievement level in math, and, 
where possible, ethnic background and classroom teacher assignment. 
The assumption was that these variables (age, sex, etc.) could signi- 
ficantly affect performance on a CAI task. 

Data for the initial achievement levels (lAL) used in matching 
subjects wftre based on achievement test scores from the computation 
sections of the Metropolitan Achievement Test or the Stanford Achieve- 
ment Tast, which had been administered during the fall of 1972. It 
was impractical to readminister tests immediately before the study 
began. Both achievement tests measured the same types of arithmetic 
skills, and nonning procedures were similar. lAL's used in the actual 
matching process were adjusted by adding one-tenth of a point to the 
achievement test scores for each month that had elapsed from the time 
of test administration to the time the students began working on the 
computer. This procedure yielded an estimate of lAL congruent with 
the assumptions on which the tests are based, i.e., that achievement 
scores normally Increase by one-tenth of a point per month during the 
school year. 

After matching on sex, age, and lAL, the attempt was made to match 
subjects on ethnicity and classroom assignment. The ethnic background 
of the students and the classrooms from which they were selected are 
listed in Appendix C. Twelve pairs of choice and yoked control sub- 
jects were Mexican-American, two pairs were Black, and the remaining 
five pairs included students from two different ethnic backgrounds. 
In ten of the pairs> the two subjects were from the same classroom. 
Demographic characteristics of the choice and yoked control groups are 
shown in Table 1. The lAL for each subject is given in Appendix B. 

Experimental Settings and Apparatus 

The CAI teletypewriters used in this study were located in a room 
which was separated from the classrooms. Two machines were placed next 
to each other near one end of the room and three-sided partitions were 
set up around each machine. A subject could observe both teletype- 
writers upon entering the room, but it was difficult for him to see the 
adjacent machine once he was seated. 
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TABLE 1 

Demographic Characteristics of the Sample 



Choice Group Yoked Control Group 

Characteristics Mean s.d. Mean s.d. 



School Grade 4.8 .42 4.8 .42 

Initial Schlevement Level 3.7 .68 3.7 .70 

Males 10 10 

Females 9 9 

Age (In months) 128 130 



A previous Investigation by Hess and Tenezakls (1970) demonstrated 
that CAI had Intense attracting Influences on students. Preliminary 
research during the six months prior to the present study Indicated 
that competing stimuli might counteract these Influences and provide 
Increased and more variable disengagement scopes for the CAI task. 
Pictures and toys were placed In the CAI room to provide competing 
stimuli for the attraction and novelty of the teletypewriter. Pictures 
of farm animals and pets were hung along the sides of each partition 
where they could be seen by the subject. A large poster of nursery 
rhyme characters and a mobile of bird figures were placed In front of 
the subjects at an angle which was approxl *ately 30 degrees above their 
line of vision. Strings run between the mobile and the teletypewriters 
allowed subjects to activate the bird figures. Two finger puppets and 
a battery-operated toy slot machine were placed on tables to the left 
of each teletypewriter. Subjects received no tangible rewards (such 
as money or candy) for playing with the toys; the only observable In- 
centive was the point score accumulated on the slot machine for various 
combinations of oranges, cherries, and lemons. 

The CAl room furniture also Included chairs for observers behind 
each student and mirrors In front of each teletypewriter. The mirrors 
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were attached to platforms approximately five feet high and tilted so 
that the observers could see the teletypewriters and the subjects easily. 

The CM Task 

The basic curriculum in this study was the Math Drill and Practice 
program described by Suppes, Searle, and Lorton (1974), This program 
was selected because it represents a highly structured means for teach- 
ing fundamental arithmetic skills, Suppes et al. (1974, p, 3) de- 
scribed the major stipulations of the program as follows: 

1. A student should master subordinate skills and concepts be- 
fore moving on to those of greater complexity or difficulty, 
regardless of his grade placement in school. This implies 
that the set of problems comprising a single topic should 

be arranged in ascending order of difficulty and complexity. 

2. The rate at which a student moves through a set of problems 
should depend On his level of performance, faster movement 
accompanying higher performance levels. 

3. Progress through each part of the curriculum should be inde- 
pendent of performance on other parts. 

In order to meet these criteria, the program was organized into 
14 strands or classes of arithmetic concepts taught in grades one 
through six. The strands are listed in Table 2. Problems for each 
strand were designed after examining three popular textbooks used ex- 
tensively in elementary schools across the United States, and grade 
levels were assigned to serve as labels for problem types and to de- 
scribe the order in which problem types were placed in a strand (Suppes 
et al., 1974, pp. 5-6). These grade level assignment:; represent 
approximations of the position of the problems in the program; they are 
subject to change as more student performance data are obtained. 

The Math Drill and Practice program is organized to present prob- 
lems which gradually change in difficulty level as a function of stu- 
dent performance. Two modifications of the program were made so that 
the effects of difficulty levels requested by the choice subjects could 
be studied: (1) difficulty levels of problems were controlled by the 
requests of choice group subjects, and (2) the problems remained at a 
particular difficulty level until the subject selected a higher or 
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TABLE 2 

Arithmetic Strands Worked by the Subjects 





Grade 


Level 


Strand 


Lowest 


Highest 


Number Concepts 


1.0 


7.5 


Horizontal Addition 


1.0 


3.5 


Horizontal Subtraction 


1.0 


3.0 


Vertical Addition 


1.0 


5.5 


Vertical Subtraction 


1.5 


5.5 


Equations 


1.5 


7.5 


Measurement 


1.5 


7.5 


Horizontal Multiplication 


2.5 


5.0 


Laws of Arithmetic 


3.0 


7.5 


Vertical Multiplication 


3.5 


7.5 


Division 


3.5 


7.5 


Fractions 


3.5 


7.5 


Decimals 


4.0 


7.5 


Negative Numbers 


6.0 


7.5 



lower one. These modifications provided a curriculum setting that pro- 
duced data concerning the choices of difficulty levels made by choice 
subjects, the difficulty levels of the problems they worked, the num- 
ber and type of problems worked by all subjects, and the percentage of 
correct responses to problems for all subjects. This Information was 
produced at a much faster rate and In greater detail than would be pos- 
sible in the usual classroom setting. 

Choice group program . At the first CAI session, problems began 
at the first difficulty level (grade level 1.0) so that choice group 
subjects could attain a high level of initial success and thus reduce 
their anxiety about the task. The program then presented problems of 
ascending difficulty levels if the subjects asked for more difficult 
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problems. During each subsequent session, choice group subjects worked 
the problems presented by the computer for approximately 15 minutes be- 
fore they were given a choice of difficulty levels. At the end of 15 
minutes, a series of questions appeared on the typewriter. 

Do you want more problems? Type Y or N. 

Do you want harder, easier, or the same types of 
problems? Type H, E, or S. 

Do you want a little, a medium amount, or a lot 
harder/easier problem? Type 1 - a little, 2 - 
a medium amount, or 3 - a lot. (Difficulty level 
was adjusted by .3, .6, or .9 of a grade level 
for the last request.) 

If a subject typed N for the first question, the lesson was termin- 
ated for that day. If a subject continued working, he/she received a 
new series of problems for approximately five minutes, followed by ano- 
ther set of the questions. Three more five-minute periods could be 
worked If the subject elected to continue. Time Intervals during 
question periods varied somewhat because the subjects controlled the 
time when the new problems would appear; the problems appeared only 
after the return key on the teletypewriter was pressed. The maximum 
time for working problems was approximately 35 minutes. 

The problems were divided Into one 15-mlnute period and four five- 
minute periods to provide the most effective conditions for measuring 
student engagement and disengagement. Preliminary research with CAI 
Indicated that behavior would become relatively stable over a 15-mlnute 
period, and that a question period preceding each subsequent five- 
minute period would provide a reasonable number of opportunities for 
choosing problem difficulty levels. 

Choice group subjects could select difficulty levels ranging from 
1.0 to 7.5; If a subject was working at level 1.0, he could ask to re- 
ceive easier problems during the next period, but he would still re- 
ceive level 1.0 problems since these were the easiest ones available. 
Similarly, subjects working at level 7.5 would continue to receive 
problems at this level when they requested harder ones. 

Information concerning the cumulative number of problems worked 
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and the difficulty levels cf these problems was printed at the hpginning 
of each lesson, about every five minutes during the 15-ininute period, at 
the beginning of each subsequent five-minute period, and at tho end of 
each lesson. The cumulative number of problems worked was computed 
daily. 

Subjects typed their answers to the problems on the teletypewriter. 
If the solution was correct and was typed in during a 20-second response 
interval, the words "Good," "Okay," "All right," or "Correct," appeared. 
An incorrect response was followed by "No, try again." If the subject 
gave an incorrect answer the second time, the correct solution appeared 
and the problem was presented a third time to elicit the co.-rect re- 
sponse. If there was no response during a 20-second pause, "Timo is 
up, try again" appeared on the printout. 

After the first session, subjects began each day with problems at 
the difficulty level of the ones they had last worked. All subjects 
worked 15 daily lessons on the computer. 

Yoked control program . The starting point for these subjects in 
the first session was also the difficulty level of 1.0. Problems for 
this group were also divided into an initial 15-minute period followed 
by five-minute blocks of problems, but there were no options to stop 
working or to select difficulty levels. The time intervals between 
five-minute periods were filled with "machine chatter" which continued 
for approximately the same length of time as the questions and responses 
on difficulty levels for the choice group subjects. Yoked control sub- 
jects worked for the same length of time as their choice counterparts 
had each day, and at about the same difficulty levels. 

Experimental Procedures 

A detailed description of the procedure followed by the obsprvers 
in introducing subjects to the task is presented in Appendix E. The 
primary goal was to show the subjects how to operate the teletypewriter, 
and to explain what types of information they would receive from the 
computer. Subjects were informed that they would work on the computer 
for 15 days, that they could play with the toys any time they wanted to. 
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and that the observers would be seated behind them to record their re- 
sponses while they worked on the teletypewriters. They were also shown 
how the mirrors and a beeper box for timing the ten-second observation 
intervals worked. All subjects were given this information either in- 
dividually or in groups of two immediately before the first lesson. 

The LOG measure (Appendix F) was administered in the CAI room be- 
fore the third and eighth days. It was readministered daring an inter- 
view after the subjects finished working on the CAI program. The major 
purpose of the interview was to ascertain why certain types of choice 
patterns appeared among the subjects in the choice group. 

The observers started each day by bringing two of the subjects 
into the CAI room» If one subject stopped working on a lesson sooner 
than the other one, a third subject was brought from a classroom. 
Each subject followed the same daily time schedule for working lessons, 
and approximately eight worked on the teletypewriters each day* Pairs 
of choice and yoked control subjects did not work their lessons at the 
same time, but an attempt was made to arrange the schedules so that 
their 15 days on the computer fell within a four- to five-week span* 

Instruments 

Engagement/Disengagement Observation Instrument 
and Observer Training 

The behavioral responses of each subject were recorded on an ob- 
servation instrument which included ten engagement and four disengage- 
ment categories (Table 3), Appendix D contains the definitions of 
these categories. At ten-second intervals, the observers checked all 
of the engagement and disengagement response categories wliich a subject 
had evidenced during that interval. Since the children were allowed to 
play with any of the various toys (finger puppets, toy slot machine, 
mobile) while they worked on the computer, their responses to the toys 
were also incorporated into the Engagement/Disengagement Observation 
Instrument, It should be noted that this instrument was not a measure 
of student response rates because only the first response which 
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TABLE 3 

Behavioral Categories for the Engagement/Disengagement 

Observation Instrument 





Engagement 




Disengagement 




1. 


Eyes on teletype paper (EP) 


1. 


Looks away from the teletype 


j:la) 


2. 


Eyes on teletype paper while 
playing with toys (EP-T) 


2. 


Looks away from the teletype 
play with toys (LA-T) 


to 


3. 


Touches teletype keys (TK) 


3. 


Turns away from the teletype 


(TA) 


4. 


Touches teletype keys while 
playing with toys (TK-T) 


4. 


Turns away from the teletype to 
play with toys (TA-T) 


5. 


Pulls closer to teletype (PC) 








6. 


Touches teletype paper (TP) 








7. 


Reads the arithmetic problems 
silently (RS) 








8. 


Talks to self about the prob- 
lems (TS) 








9. 


Counts on fingers (CF) 








10. 


Surprise (S) 









occurred within each category during a ten-second interval was recorded 
by the observers. 

Three observers were trained to use the Engagement/Disengagement 
Observation Instument in practice sessions at the Stanford Center for 
Research and Development in Teaching. Sessions were approximately 
two hours long and occurred three days per week for a month. Observers 
practiced recording the engagement and disengagement of students on 
videotaped CAI lessons. Feedback was given concerning the accuracy of 
these observations fr^m a research assistant who supervised this phase 
of the training. Further practice sessions and feedback were also pro- 
vided in the school during a two-month period prior to the beginning of 
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the study. The observers worked with several of the fifth-grade pupils 
who were not included in the study during this time; they also re- 
hearsed the experimental procedure to be followed with the choice and 
yoked control groups. 

Reliability . Reliability data for the Engagement /Disengagement 
Observation In trument was obtained by recording interobserver agree- 
ment for ten-second intervals. Reliability measures were obtained on 
twelve different occasions from January through May of 1973 and were 
based upon the observations of three different observer pairs. Table 4 
shows the average percentage of agreement among all 3 pairs of observ- 
ers. 

TABLE 4 

Percentages of Interobserver Agreement for 
Engagement/Disengagement Observation 
Instrument Categories 

Mean Agreements 
Categories First 15 Minutes Five-Minute Blocks 



(n « 12) (n « 7) 



Engagement 

Eyes on paper - plays with toys .99 .80 

Touches keys - plays with toys .95 .70 

Pulls closer .99 1.00 

Touches paper 1.00 .98 

Reads silently .95 .97 

Talks to self .93 .93 

Counts on Fingers .98 1.00 
Disengagement 

Looks away - plays with toys .95 .95 

Turns away - plays with toys .99 .99 



Some categories were combined in order to give single measures of 
interobserver agreement. This procedure was followed because these 
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combined categories included similar behaviors. The Surprise category 
responses were not analyzed since so few of them occurred* 

Engagement/disengagement rating scale . In order to measure the 
intensity of subject behaviors, every ten-second observation interval 
was assigned two separate ratings, one for engagement and one for dis- 
engagement. Ratings ranged from zero to four for both categories. To 
determine ratings for various combina^-ions of behaviors, six members 
of the research staff and the three observers rated each combination 
that occurred in the data; high agreement levels were established after 
several periods of discussion and rating. Examples of behavior combin- 
ations and ratings are shown in Table 5. 

Ratings assigned to each ten-second interval on the Engagement/ 
Disengagement Observation Instrument were summarized by computer into 
average engagement and disengagement levels during the five-minute per- 
iods and the 15-minute periods the subjects worked on the CAI task. 
The 15-minute periods were also divided into three five-minute periods 
for this and other data analysis. The five-minute period data were 
used to calculate mean engagement and disengagement levels per day for 
the subjects; daily engagement and disengagement levels were then used 
in the statistical analysis. 

The Locus of Control Measure 

The LOG measure contained 28 items; each item contained a stem 
followed by two possible responses. For example: 

If I do well on my computer math problems, it is 
because 

I tried hard 

Just good luck, I guess 

Four stems were used; two described successful outcomes and two 
described failure. The success stems were: ''If I do well on my com- 
puter math problems, it is because and "When I finish a com- 
puter math problem quickly, it is because . . . ." The failure stems 
were: "If I don't do well on my computer math problems, it is because 
. . . ," and '*When it takes me a long time to do a computer math 
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TABLE 5 

Examples of Behavior Combinations and Engagement/ 
Disengagement Scale Ratings 



Behavior 



Rating 



Engagement 
No Indicators 

Pulls closer and touches keys or 
Eyes on paper and touches key(s) 
with toy 

Eyes on paper and touches key(s) 
or Eyes on paper and pulls closer 

Eyes on paper, touches key(s), and 
pulls closer or Eyes on paper, 
touches key(s) and touches paper 

Eyes on paper, touches key(s), 
pulls closer, and touches paper 
or Eyes on paper, touches key(s), 
pulls closer and reads silently 

Disengagement 

No Indicators 

Looks away 

Turns away £r Looks away to play 
with toys 



Turns away to play with toys o£ 
Turns away and looks away to 
play with toys 

Looks away to play with toys and 
turns away to play with toys or 
Turns ^way, looks away to play 
with toys, and turns away to 
play with toys 



1 
2 



0 
1 



problem, it Is because . . . Each stem was used for seven Items. 
Pairs of alternatives followed each of the two stems for success and 
each of the two stems for 1 allure. The pairs of responses Involved 
attrlbuti^'ons of effort, ability, task difficulty, luck, and choice. 



17 



The response alternatives for success and failure on effort, for exam- 
ple, were: "I tried hard," and "I didn't try hard enough." 

The alternatives for choice attributions were different for the 
yoked control subjects than they were for the choice subjects. Choice 
subjects received the alternatives: "I asked for the right problems," 
and "I didn't ask for the right problems." Yoked control subjects re- 
ceived: "I let the computer give me the right problems," and "I didn't 
let the computer give me the right problems." The LOG measure is in 
Appendix F. 

Locus of control scores . Frequencies of effort, ability, task 
difficulty, luck, and choice attributions were tabulated separately 
for success and failure alternatives for each subject. These frequen- 
cies were then combined to produce attribution for success and attri- 
bution for failure scores on each of four dimensions: stable/unstable, 
control/no control, internal/external, and self/other. 

The stable/unstable dimension was found by Weiner (1972) to be re- 
lated to changes in expectations of success or failure. It can be con- 
founded with the internal/external dimension for some LOG measures. 
Stable refers to the attribution of an outcome to stable, unchanging 
factors; unstable refers to attribution of the outcome to variable fac- 
tors. In this study, the score for the stable/unstable dimension was 
the number of attributions to ability when the alternative was effort, 
luck, or task difficulty (six comparisons). 

Control was defined as the attribution of outcomes to factors that 
can be changed; no control as the attribution to random or predetermined 
factors. The control/no control dimension score was obtained from the 
number of attributions to effort or task difficulty when the alternative 
was either ability or luck (eight comparisons). 

The internal/external dimension is the one tapped by raos: LOG mea- 
sures. Attribution of outcome in this dimension is either to something 
about the subject himself (internal) or to a source outside the subject 
(external). In this study an internal/external score was assigned on 
the basis of the number of attributions to ability or effort when the 
alternatives were task difficulty or luck. Separate scores were 
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derived for success and for failure alternatives; eight comparisons were 
used for each score. 

The self /other dimension was unique to this study. The attribution 
of outcome to factors under the subject's own control were considered 
self; attributions to controllable factors where control lies witli eome- 
one or something other than the subject were considered other. The 
self/other score was based on the number of attributions to choice or 
effort when the alternative was task difficulty (four comparisons). 

A test-re test reliability analysis of the LOG measure showed that 
the average measure of internal consistency calculated by the Spearman- 
Brown formula for the four dimensions was Appendix G contains the 
details of this analysis. 

Results 

Performance Data 

Both the choice and the yoked control groups of subjects spent an 
average of 4.3 five-minute periods per session on the computer (s.d. = 
1.2). Some discrepancies in difficulty levels between the pairs of 
subjects were apparently caused by a slight upward drift of che problems 
when choice gro^ip subjects requested problems of the same difficulty. 
The average difficulty level of problems worked by the choice group was 
2.5, for the yoked control group it was 2.3. Table 6 shows mean diffi- 
culty levels of problems worked, percentages of correct responses, and 
number of problems worked per five-minute period for each of the 19 
pairs of subjects. 

The percentage of correct responses and number of problems worked 
for the two group? were compared usinc a t test. Significant differ- 
ences were found in both instances (p < .01); means for the choice 
group were lower than those for the yoked control group (r = -2,63 and 
t = -4.97 for percentage correct and number of problems, respectively). 

Engagement and Disengagement Levels 

To test the construct validity of the engagement and disengagement 
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measurements, correlations between average engagement and disengagement 
levels across the 15 days of the CAI sessions were computed. For the 
choice group subjects, mean engagement and disengagement levels were 
correlated -.60 (p < .01); for the yoked control subjects the correla- 
was -.25. These negative correlations appear to support the construct 
validity of both the Engagement/Disengagement Observation Instrument 
and the Engagement /Disengagement Rating Scale, since they Indicate the 
expected relationship between the two dependent variables. High engage- 
ment levels were more likely to be associated with low disengagement; 
and low engagement levels tended to be associated with high disengage- 
ment levels. 

The first experimental question asked whether the opportunity to 
choose problems of various difficulty levels would Increase engagement 
and decrease disengagement levels for subjects on a CAI task. Compari- 
sons of engagement levels for choice and yoked control subjects showed 
that students who chose difficulty le^'els displayed higher levels of 
engagement than students who had no choice. 

Two procedures were used to compare levels of engagement and dis- 
engagement for the two groups of subjects. First, levels for the ten- 
second observation Intervals within the five-minute periods were 
arranged for inspection. Table 7 shows these levels for the two 
groups; the choice group appears consistently higher in engagement than 
the yoked control group. No statistical tests were applied to these 
figures because the number of subjects in periods four through seven 
varied as a function of the choice group subjects' decisions to termin- 
ate or continue after the first 15 minutes. 

The second procedure used to compare levels ol engagement and dis- 
engagement for choice and yoked control groups employed an analysis of 
variance. One ANOVA was done with difference scores obtained by sub- 
tracting the engagemert level mean of each yoked control subject from 
the engagement level mean nf the choice member of the pair for each of 
the 15 days on the computer. A second ANOVA used disengagement differ- 
ence scores. 
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TABLE 7 

Mean Engagement and Disengagement Levels for 
Five-Minute Periods on the CAI Task 



Periods 



Levels 



Engagement 

Choice Group 2.20 2.17 2.17 2.19 2.16 2.10 2.15 

Yoked Control Group 2.06 2.06 2.07 2.06 1.98 1.96 1.96 

Disengagement 

Choice Group .20 .20 .20 .19 .24 .19 .19 

Yoked Control Group .20 .18 .17 .29 .17 .18 .22 



The ANOVA model used here is analogous to a t test for paired data. 
It should be noted that the difference scores represent different ex- 
perimental conditions and are not pretest-posttest comparisons. ANOVA 
results for engagement difference scores are summarized in Table 8; 



TABLE 8 



Summary of the Analysis of Variance of 
Engagement Difference Scores 



Source 



Sum of 
Squares 



Degrees of 
Freedom 



Mean 
Square 



Groups 3.96 

Sex 0.31 

Pairs (within sex) 13.39 

Days 1 . 06 

Days x Sex 2.65 

Days X Pairs (within sex) 31.04 



1 
1 
17 
14 
14 
238 



3.96 
0.30 
0.79 
0.08 
0.19 
0.13 



5.03* 
0.39 

0.62 
1.46 



*p < .05 
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disengagement results are in Table 9. Main effects tested were group 
(choice or yoked control), sex of subjects, and days on the CAI task 
(15); the error terms were pairs within sex and the interaction of days 
and pairs within sex. Only the main effect for group was significant 
(F » 5.03, p < •05). There were no significant main effects for sex or 
days. 



TABLE 9 

Summary of the Analysis of Variance of Disengagement 
Difference Scores (Logarithms) 



Source 


Sum of 
Squares 


Degrees of 
Freedom 


Mean 
Square 


F 


Groups 


O.ll 


1 


0.11 


0.02 


Sex 


7.96 


1 


7.96 


1.17 


Pairs (within sex) 


115.98 


17 


6.82 




Days 


3.05 


14 


0.22 


0.76 


Days X Sex 


5.04 


14 


0.36 


1.24 


Days X Pairs (within sex) 


70.09 


238 


0.29 





Disengagement difference scores were subjected to logarithmic 
transformations for the ANOVA. No significant effects were shown in 
this analysis (Table 9). 

Mean engagement and disengagement levels for the two groups are 
shown in Table 10. The mean engagement level for choice subjects is 
clearly higher than that for yoked control subjects. This difference 
is underscored by the finding that 16 of the 19 choice group subjects 
showed higher average engagement levels than their yoked control 
counterparts. 

Another issue in the engagement and disengagement data was whether 
the engagement and disengagement levels for all subjects would change 
over the 15 days of CAI expx^rience. The ANOVA model used here included 
days as the main effect and subjects repeated over days as the error 
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TABLE 10 

Means and Standard Devlptlons of Engagement 
and Disengagement Levels for the 
15 Days of CAI Experience 





Choice Group 


Yoked Control Group 




Engagement Disengagement 


Engagement Disengagement 


Mean 


2.17 .21 


2.05 .21 


s.d. 


.22 .17 


.21 .16 



term. This analysis Indicated that a significant decline occurred In 
the engagement scores (Table 11) and a significant Increase occurred 



TABLE 11 

Summary of the Analysis of Variance for All 
Engagement Scores from Days 1-15 



Sum of Degrees of Mean 
Source Squares Freedom Square F 

Subjects 37.60 18 2.09 

Days 4.14 14 0.30 2.12* 

Subjects X Days 35.19 252 0.13 

*p < .05 



In the disengagement scores (Table 12). In addition, the average num- 
ber of flve-mlnure periods worked on the computer declined between day 
1 and day 15 (Table 13). These results suggest that there was a gen- 
eral lessening of Interest in the CAI task for both groups of subjects. 
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TABLE 12 

Summary of the Analysis of Variance for All 
Disengagement Scores from Days 1-15 



Sum of Degrees of Mean 
Source Squares Freedom Square F 

Subjects 8.63 18 0.48 

Days 5.94 14 0.42 5.09* 

Subjects X Days 20.99 252 0.08 

*p < .05 



TABLE 13 

Summary of the Analysis of Variance of the Number 
of Five-Minute Periods Worked from Days 1-15 

Sum of Degrees of Mean 
Source Squares Freedom Square F 

Subjects 407.13 18 22.62 

Days 112.72 14 8.05 6.76* 

Subjects X Days 300.30 252 1.19 



*p < .05 



The Relationship Between Engagement and Difficulty Levels 

The second experimental question was whether there would be a cur- 
vilinear relationship between engagement and the difficulty levels of 
the problems chosen by the students, i.e., were extreme discrepancies 
between initial achievement and the difficulty levels selected related 
to the lowest engagement and moderate discrepancies associated with 
the highest engagement? "^n order to determine how these variables were 
related, the average engagement levels per day were grouped into eleven 
categories, each category representing the difference between the lAL 
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and the average difficulty level of the problems worked for one day. 
Statistical analysis was not used because the engagement means were not 
derived from completely independent data sources, i.e., the engagement 
scores for a subject could be included in more than one difference cate- 
gory. 

The relationship between difference scores and engagement levels 
seemed to be more linear than curvilinear, i.e., the positive differ- 
ence scores were generally associated with higher engagement levels and 
lower disengr.gement levels than were the negative difference scores. 
The choice group data in Table 14 indicate that engagement in the CAI 
task was highest when the difficulty levels of the problems worked were 
considerably lower than the subject's lAL. Similar results were found 
for the yoked control group. Hunt's (1961) statements about the prob- 
lem of the match do not appear to be supported in these data; however, 
the choice patterns found for some of the subjects do shed some addi- 
tional light on the choice-of-dif f iculty-level issue. 

Choice Patterns 

The third experimental question was whether patterns of student 
choice would emerge from the choice group data. Two such patterns 
were identified; one was shown by students who consistently chose to 
work easier or the same difficulty level problems while maintaining a 
high percentage of correct responses (mean of 91 percent). These sub- 
jects were labeled Maximizers since their choices had the effect of 
maximizing ta^tk performance. 

A second pattern was shown by subjects who performed at much lower 
levels (mean of 53 percent correct responses) and consistently requested 
harder or the same difficulty level problems. Subjects who showed this 
second pattern were labeled Minimizers, since their choices had the ef- 
fect of minimizing their performance levels on the task. Some of the 
choice group subjects mi*de so few choices that no patterns could be 
seen; subjects who made fewer than nine choices during the 15 days were 
labeled Few Choice subjects. 
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TABLE 14 

Relationship Between Difference Scores and Means and 
Standard Deviations for the Engagement and 
Disengagement of the Choice Group 



Ranges of Difference Engagement Disengagement 
Scores N Mean s,d> Mean s.d. 



4.00 


to 


3.01 


11 


2.50 


.30 


.07 


.10 


3.00 


to 


2.51 


55 


2.35 


.46 


.12 


.17 


2.50 


to 


2.01 


46 


2.13 


.33 


.22 


.25 


2.00 


to 


1.51 


61 


2.13 


.22 


.18 


.26 


1.50 


to 


1.01 


45 


2.11 


.15 


.15 


.13 


1.00 


to 


-0.01 


21 


2.18 


.40 


.30 


.40 


0.00 


to 


-0.99 


7 


2.30 


.19 


.20 


.28 


-1.00 


to 


-1.99 


2 


1.99 


.03 


.17 


.08 


-2.00 


to 


-2.99 


26 


2.04 


.32 


.27 


.28 


-3.00 


to 


-3.99 


1 


1.77 




.42 




-A. 00 


to 


-4.99 


11 


1.64 


.29 


.80 


.23 



Difference scores were obtained by subtracting the average 
daily difficulty level of the problems chosen by each subject from 
that subject's lAL. The range 4.00 to 3.01, for example, means that 
the average difficulty level of the problems chosen by N subjects 
was between 3.01 and 4.00 levels lower, i.e., easier, than their lAL. 
Each difference interval is 1.00 grade wide except in those cases in 
which the N in the interval was large enough to justify its being 
further divided into two intervals of .50 each. N is the number of 
daily averages from which the engagement and disengagement means for 
the interval were calculated. 

^The range of possible engagement and disengagement scores 
was 0 to 4. 



These patterns emerged from a fairly complex analytical procedure. 
The choices of difficulty levels made by choice group subjects were 
first tallied according to (a) the percentages of correct responses 
prior to a particular choice and (b) the program option chosen by the 
subject, e*g., a lot harder, a little easier, etc. The choices made 
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after the first 15-mlnute period on the computer were initially tallied 
separately from the other choices because it was believed that the 
types of decisions made then might have differed systematically from 
those which occurred after later periods. All of the choices were sub- 
sequently combined into one matrix, however, because no distinct dif- 
ference in choice pattern was found. 

Choices made by each choice group subject were tallied in three 
categories. All choices involving a request for harder problems (a 
little, a moderate amount, or a lot harder) were classified as minimiz- 
ing. In addition, choices of "same" following zero to 70 percent cor- 
rect were also classified ^s minimizing responses. Similarly, all re- 
quests for easier problems, and choices of "same" following 86 to 100 
percent correct, were classified as maximizing responses. Choices of 
"same" following performance levels between 71 and 85 percent correct 
were classified as neither. 

The rationale for classifying the same choices in the preceding 
manner is as follows: It was assumed that a same selection subsequent 
to 100 to 86 percent correct performance was motivated by the desire to 
continue receiving "easy" problems, and therefore maintain a high level 
of performance. In contrast, the choice of same after 70 to zero per- 
cent correct performance might have been caused by the desire to re- 
ceive more "hard" problems in order to continue working on either a 
challenging or socially appropriate lesson. The same choices which 
occurred in the 71 to 85 percent range were considered as being neither 
maximizing nor minimizing because they followed performance levels that 
were not extremely high or low. 

It appears that this classification method does not unduly com- 
bine one kind of c loice following 100 to 86 percent with another kind 
of choice occurring after 70 to zero percent performance because the 
actual choice behavior of most of our subjects was usually associated 
with a specific percentage correct range. Thus, the harder choices 
most frequently occurred in conjunction with the lower percentage cor- 
rect range while the easier choices were usually associated with the 
higher range. 
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After the individual tallies were complete, seven subjects were 
classified as Maximizers because at least 70 percent of their choices 
were in the maximizing category. One subject was added because the 
majority of his choices were maximizing and the pattern seemed clear 
(29 maximizing » 9 minimizing, and 15 neither). 

Four choice group subjects were classified as Minimizers, using 
the same (70 percent) criterion, and another was included because of a 
clearly minimizing choice pattern (6 minimizing, 1 maximizing, and 3 
neither). Six subjects made too few choices to demonstrate any pat- 
terns. Performance data for the three subject classifications are in 
Table 15. 

TABLE 15 

Performance Data for the Maximizers, Minimizers, 
and Few Choice Subjects 

Initial Achievement Difficulty Percentage of 

Level Level Current Responses 



Subjects 




Mean 


s.d. 


Mean 


s.d. 


Mt an 


s.d. 


Maximizers 


(N-8) 


3.39 


1.23 


l.Al 


.34 


91% 


4.22 


Minimizers 


(N=5) 


A. 06 


.70 


5.22 


1.49 


53 


11.72 


Few Choice 


(N»6) 


3.83 


.37 


1.67 


.34 


86 


6.11 



Although the numbers of subjects here are small, it seems clear 
that distinct types of choice patterns are represented because of the 
consistency of the minimizing and maximizing patterns, especially 
after the second and third days of CAI. These results also parallel 
those of the pilot work in this area. 

The Relationship Between Engagement and Choice Patterns 

The relationships between engagement levels and difference scores 
(lAL minus chosen difficulty level) for Maximizers, Minimizers, and 
Few Choice subjects are shown in Table 16. The highest engagement 
levels appear to have been associated with high positive difference 
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TABLE 16 

Relationship Between Difference Scores and Means and Standard 
Deviations for the Engagement and Disengagement of 
Maxlmlzers, Mlnlmlzers, and Few Choice Subjects 



Ranges of Difference Maxlmlzers Minlmlzers Few Choice Subjects 
Scores Eng, Dls, Eng, Dls, Eng, Dls, 



4.00 to 3.01 


X 


2.46 


.03 


2.12 


.19 


2.66 


.05 


(N»3.2.6)^ 


s. d. 


.13 


.02 


.27 


.25 


.21 


.03 


3.00 to 2.51 


X 


2.20 


.14 


2.46 


.04 


2.52 


. 11 


(28. 5. 22) 


s.d* 


.67 


.21 


.17 


.03 


.51 


.11 


2.50 to 2.01 


X 


2.05 


.26 


2.54 


.04 


2.19 


. 19 


(28. 1. 22) 


s.d. 


.36 


.32 






.27 


.14 


2.00 to 1.51 


X 


2.15 


.18 






2.10 


. 19 


(31, 0, 29) 


s.d. 


.29 


.27 






.38 


.25 


1.50 to 1.01 


X 


2.08 


. 14 


2.32 


.11 


2. 11 


O 1 

. 21 


(30. 4. 11) 


s.d. 


.42 


.13 


.09 


.06 


.14 


.15 


1.00 to 0.01 


X 


2.06 


.12 


2.22 


.36 






(5, 16, 0) 


s.d. 


.07 


.07 


.45 


.44 






0.00 to -0.99 


X 






2.30 


.20 






(0, 7, 0) 


s.d. 






.19 


.7.8 






-1.00 to -1.99 


X 






1.99 


.17 






(0, 2, 0) 


s.d. 






.03 


.08 






-2.00 to -2.99 


X 






2.04 


.27 






(0, 26, 0) 


s.d. 






.32 


.28 






-3.00 to -3.99 


X 






1.77 


.42 






(0, 1, 0) 


s.d. 














-4.00 to -4.99 


X 






1.64 


.80 






(0, 11, 0) 


s.d. 






.29 


.23 







denotes the number of dally averages from which the engagement 
and disengagement means for the Maxlmlzers, Minlmlzers, and Few Choice 
subjects, respectively, were calculated. 
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scores, indicating difficulty levels considerably below lAL. Since low 
difficulty levels were selected both near the beginning and near the 
end of the CAI experience, this phenomenon does not appear to be a func- 
tion of boredom toward the end of a task. 

The Maximizers most frequently chose difficulty levels lower than 
their lAL (difference scores between 1.00 and 3.00). Thus, their high- 
est engagement levels were associated with the most frequently selected 
difficulty levels. This relationship was not found among the Minimiz- 
ers, however, since they most frequently selected difficulty levels 
that were associated with the lowest engagement levels (difference 
scores between -4.99 and 1.00). Thus, despite the fact that their en- 
gagement was higher when they chose easier problems, Minimizers consis- 
tently chose the harder ones. 

Choice and Locus of Control Attributes 

The fourth experimental question asked whether giving subjects a 
choice of difficulty levels would affect their LOC perceptions. This 
question was answered by comparing the scores of the choice and yoked 
control groups on the four LOC dimensions. The scores used in this an- 
alysis were derived from the difference between raw scores for members 
of each subject pair. Separate scores were computed for the success 
and failure items of each of the four dimensions and three administra- 
tions of the LOC measure. The scores were then organized by treatment 
(choice or yoked control), choice pattern shown by the choice subjects 
(Maximizers, Minimizers, and Few Choice subjects), typr^ of score (suc- 
cess or failure), and day (first, second, or third administration of 
the LOC measure). A separate ANOVA was performed for each dimension 
of the LOC measure. 

The mean difference scores and F ratios for the treatment main ef- 
fect are presented for each dimension in Table 17. Full summary tables 
are in Appendix H. The F values indicated that the choice and yoked 
control subjects were significantly different on the stable/unstable, 
internal/external, and self /other dimensions. Subjects in the yoked 
control group made significantly more stable/unstable and internal/ 
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external attributions than did subjects in the choice group; the reverse 
was true for the self /other dimension attributions. The means for 
choice and yoked control subjects are presented in Table 18. 

TABLE 17 

Mean Difference Scores and F Values 
for Each LOG Dimension 

Stable/ Control/ Internal/ Self/ 

Unstable No Control External Other 

Mean Difference Scores -.78 .48 -.81 .39 

F Values (df » 1/16) 24.93** 2.63 8.70** 6.35* 

*p < .05 
**p < .01 



TABLE 18 

Group Means and Possible Ranges of Scores 
on the Four LOG Dimensions 





Stable/ 


Control/ 


Internal/ 


Self/ 




Unstable 


No Control 


External 


Other 


Choice Group 


2.28 


A. 84 


4.46 


2.65 


Yoked Control Group 


3.06 


4.36 


5.28 


2.26 


Possible Score Range 


0-6 


0-8 


0-8 


0-4 



The choice pattern main effect in the stable/unstable dimension was 
also significant (F » 8.68, p < .01); difference scores for the Maxiraiz- 
ers, Minimizers, and Few Choice subjects and their yoked control counter- 
parts were -1.44, -.37, and .25, respectively. A Newman-Keuls multiple 
comparison test revealed that the Maximizer difference score of -1.44 
was significantly greater than the two other difference scores (p < .01). 
Maximizers obtait ed the lowest mean score on this dimension while their 
yoked control counterparts showed the highest mean (Table 19). 



32 



TABLE 19 

Means for Choice and Yoked l-ontrol Subjects 
on the Stable/Unstable Dimension 

Maximizers Minimizers Few Choice 



Choice Group 1,94 2,04 2.95 

Yoked Control Group 3.34 2.40 3.20 



Note: The terms Ilaximizers, Minimizers, and Few Choice apply only 
to the subjects in the choice group, but the table is arranged in this 
manner to compare yoked control subjects with their choice counterparts. 

The analyses of variance showed no significant effects for choice 
pattern, type of score, or day on the control/no control, internal/ 
external, and self /other dimensions. A significant F ratio was associ- 
ated with a type-of-score and choice-pattern interjaction in the analysis 
of the internal/external dimension (F « 14.9, p < .01). The mean dif- 
ference scores for this dimension and the averages from which they were 
derived are given in Table 20. 

TABLE 20 

Means for che Choice and Yoked Control Choice Patterns 
on the Internal/External Dimension 



Success Failure 

Choice Yoked Difference Choice Yoked Difference 
Group Control Score Group Control Score 



Maximizers 


3.50 


4.1.. 


- .62 


4.56 


6.83 


-2.25 


Minimizers 


3.93 


5.53 


-1.60 


4.67 


3.67 


3-00 


Few Choice 


4.67 


4.50 


.17 


5.6i 


6.67 


-1.06 
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A Newraan-Keuls test showed that the difference score of 1.00 for 
the Minimizers on the failure items was significantly different from 
the other choice pattern scores. In four of the comparisons between 
patterns, the yoked control subjects had higher scores than the choice 
subjects for failure items; the opposite result was found for Minimiz- 
ers and their yoked control counterparts on failure items. The magni- 
tude of the difference between Few Choice subjects and their yoked con- 
trol counterparts was much less than for the other choice pattern sub- 
jects. One way to summarize these results would be to say that the 
subjects yoked to the Minimizers seem to have the most different scores 
they show the highest mean for success and the lowest mean for failure 
on the internal/external dimension. 

Correlations Between Engagement Levels and Locus of Control Scores 

The final experimental question was whether LOG attributions and 
engagement scores were correlated. Engagement and disengagement scores 
for this analysis were obtained by averaging levels for the first five 
days, the middle five days, and the last five r'uys of CAI for each sub- 
ject, so that they would be roughly comparable in time to the three ad- 
ministrations of the LOC measure. Pearson correlations were then cal- 
culated between engagement levels and success attribution scores and 
between engagement levels and failure attribution scores of the two 
groups of subjects (choice and yoked control). The correlations were 
calculated separately for success and failure itews because there is 
some evidence that attributions for failure and success may at times he 
independent (Crandall, Katkovsky, & Crandall, 1^65) and because there 
is considerable evidence that success and failure LOC attributions arf 
differentially related to variables similar to engagement, e.g., per-- 
oistence and intensity or speed of performance (Weiner et al., 1972). 

Success items on the stable/unstable, control/no control, internal 
external, and self /other dimensions for the first administration of the 
LOC measure were correlated separately with the engagement and disen- 
gagemtnt means for the first five days of CAI. Correlations were also 
calcul^kted for the third administration of the LOC measure and the 
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engagement and disengagement means for the last five days of CAI. For 
success items, there were thus 16 correlations for each of the choice 
and yoked control groups. The same variables were correlated for fail- 
ure items. 

The critical level for significance on the correlations was set at 
.46 (tvo-tailed test with p < .05 and df * 17). No significant corre- 
lations were found in the choice group data between engagement and LOG 
attributes for either LOG administration. Two significant correlations 
for the choice group vere found between disengagement and LOG attribu- 
tions: the correlation between control/no control scores on the first 
LOG administration and disengagement means for the first five days of 
CAI was .54 for failure items. For the success items, the correlation 
between internal/external scores on the third LOG administration and 
disengagement means for the last five days of GAI was .48. 

In the yoked control group data for the third LOG administratioa, 
a significant correlation of .49 between stable/unstable dimension 
scores and engagement means for the last five days of GAI was found for 
success items. A correlation of .49 was also found between self /other 
scores on the third administration and disengagement means for the last 
five days of GAI on failure itei^s. 

These findings are somewhat puzzling. It was expected that there 
would be more correlations in the choice group data, particularly on 
the self/other dimension. The expectation was based on the assumption 
that the self /other dimension scores and the engagement scores would 
show increases or decreases in the same dirrection over time because of 
emerging individual differences in subject responses to the treatment. 

Discus sion 

A number of interesting features in the data merit further discus- 
sion. 

1* The yoked control group worked significantly more problems on 
the computer than did the choice group. This may have been because the 
yoked control subjects worked problems at lower difficulty levels and 
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answered a higher percentage of the problems correctly — that is, easier 
problems could be responded to faster, and thus more problems could be 
worked per day. However, this explanation does not account for all of 
the differences in the number of problems worked by the two groups. 
Some of the pairs who were matched closely on difficulty levels and 
whose percentages of correct responses were almost identical (pairs 1, 
5, and 9) still differed in the number of problems worked — the yoked 
control subjects working substantially more problems per day than their 
choice counterparts. One of the yoked subjects (ia pair A) did about 
ten more problems per day than his choice counterpart, although his per- 
centage of correct responses was nine poirts lower. These comparisons 
between the choice and yoked control subjects suggest that the differ- 
ences in the number of problems worked might have resulted from some 
factor or factors other than the lower difficulty levels and higher per- 
centages of correct responses obtained by the yoked control subjects. 

One highly speculative explanation is that because the choice group 
was significantly higher in engagement than the yoked control group, the 
lower number of proMems worked by the choice group might have resulted 
from the effects of the experimental treatment — i.e., the hJgher engage- 
ment levels could indicate more involvement in solving each problem, 
resulting in response rates that were slower than those of subjects who 
did not choose problems. An alternative explanation is that the choice 
group subjects were not accustomed to making the decisions required in 
the CAI situations and were therefore slower and more cautious in re- 
sponding to the problems than were the yoked control subjects. 

2. Another interesting feature of the data was the significant 
difference found between the engagement levels of choice and yoked con- 
trol groups. One might argue that this difference is educationally un- 
important because the means of these groups were only .12 points apart. 
However, it should be noted that the choice group was consistently 
higher in engagement than the yoked control group across all of the 
five-minute periods. Although the period-by-period data were not 
tested statistically, these consistent differences indicate that the 
subjects in th% choice condition maintained higher levels of engagement 
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over longer periods of time than did subjects in the yoked ^:ontrol con- 
dition. Therefore, the significant difference between the overall mean 
engagement levels of the two groups may be educationally important be- 
cause this difference appears to be based upon an effect that is stable 
over time. However, the educational implications of this finding for 
classroom learning are unclear at present, since it is not known how 
engagement levels are related to academic achievement on standardized 
tests. If future investigations demonstrate that choice situations 
lead to higher engagement levels which in turn produce higher achieve- 
ment scores than do nonchoice situations, then the educational effects 
of giving students choices over certain parts of their curricula will 
be more clearly demonstrated. Since the present study does not provide 
such information, what bearing do these engagement results have upon 
understandi-»g the academic effects of choice situations? In our opin- 
ion, they suggest that choice settings might improve achievement levels 
by causing students to attend more closely to each problem. The signi- 
ficantly higher mean engagement level found for the choice subjects is 
educationally important because it demonstrates how the initial atten- 
tional phase of the classroom learning process can be improved. In 
this regard, increased engagement per se is a desirable educational 
goal, and investigations of variables that can increase student engage- 
ment levels should not have to be directly linked to achievement test 
measures in order to prove their educational significance. Learning 
situations that increase engagement levels might have important affec- 
tive influences upon student attitudes toward studying different types 
of curricula, and these affective influences might be just as important 
as increased achievement levels. 

3. The finding that student engagement levels decreased as the 
difficulty levels of the chosen problems increased from 1.0 to 7.5 is 
particularly relevant to educational practices. These results are not 
congruent with Hunt's theory of the match (1961, 1965), since engage- 
ment was not highest for problems most similar to the initial achieve- 
ment levels of the subjects, nor lowest for problems that were most 
different* It appears that soE.e factors other than a need or desire 
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to select problems similar to current achievement level influenced the 
subjects' choices of problems. The Maximizer and Minimizer choice pat- 
tern findings indicate that the problems most frequently selected by 
the Maximizers were about two grade levels below their lAL, while those 
most frequently chosen by the Minimizers were about three grade levels 
above their lAL. These findings suggest that the Identification of op- 
timally stimulating difficulty levels involves more complex processes 
than Hunt's theory predicted. Optimally stimulating problem difficulty 
levels seem to be related more to the choice patterns of the subjects 
than to one theoretical motivation curve that can be applied to all 
learners. In this experiment, the difficulty levels most frequently 
chosen by Maximizers were related to their highest engagement levels. 
However, the opposite result was found for the Minimizers; their least 
frequently selected difficulty levels were most engaging for them. 

Interviews 

Maximizers and Minimizers were interviewed to determine whether 
school-related factors such as classroom pressures caused them to 
choose certain difficulty levels. The interview responses are included 
in this section of the report because they were used to provide some 
post hoc information about why the subjects showed certain choice pat- 
terns. We expect to use this information to design future studies. 
In the interview, students were asked, "Why would a boy or girl select 
easier problems almost all of the time while working on the computer?" 
and "Why would a boy or girl keep asking for harder problems?" The re- 
sponses fell into three categories: 

1. Academic responses centered around classroom activities, e.g., 
"The student chose these problems so he would know them if 
they were given in class." 

2. Intellectual responses related to the desire to engage in an 
intellectually stimulating activity, e.g., "The student 
selected these problems to test his skills." 

3. Physical responses related to a physical condition or motive, 
e.g., "The student selected these problems in order to move 
through the program faster." 
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Both Maxlraizers and Miniraizers gave more intellectual than academic 
or physical responses. A breakdown of the intellectual category into 
positive responses (problems selected to test one's ^.^ill or chosen out 
of curiosity, etc.) and negative responses (problems selected to avoid 
failure or chosen out of habit) revealed that the Minimizers gave more 
positive intellectual responses to the two questions than did the Maxi- 
mizers; the reverse was true for the negative intellectual responses. 
If we assume that the students' responses to these questions are indi- 
cators of their own motives for selecting problems, then it appears 
that the Minimizers were directed by more achievement-oriented motives 
than were the Maximizers. Although a need-f or-achievement pretest mea- 
sure was not used in this study, the performance of the Minimizers re- 
sembles that for high need achievers described by Atkinson (1964), 
i.e., their performance was in a range which he suggested was most de- 
sired by high need achievers. The performance of the Maximizers also 
seems to fit Atkinson's theory; their high percentage of correct re- 
sponses resembles the performance of low need achievers. Further re- 
search, using appropriate pretest measures of student motivation, is 
needed to determine whether these post hoc statements about achievement 
motives are valid. 

Specific Locus of Control Attributions 

Additional analyses were also done on the LOG data. Choice and 
yoked control group differences in the specific attributions within the 
four dimensions were analyzed: attributions to ability, effort, diffi- 
culty of the problems as chosen by the computer, difficulty of the prob- 
lems as chosen by the student, and luck. This analysis indicated that 
subjects in the choice group attributed more of their performance re- 
sults to their choice of problem difficulty levels and less to their 
ability than yoked control subjects did. The significant differences 
between choice and yoked control subjects on the self/other, stable/ 
unstable, and internal/external diir<insions may have been caused primar- 
ily by differences in attributions to sources controllable by the self. 

The types of choices made or received by the subjects had a 
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significant relationship to LOG attributions on the stable/unstable di- 
mension. The mean difference between choice and yoked control groups 
in stable (i.e., ability) attributions was greater for the Maxiinizers 
than for either the Minimizer or the Few Choice subjects. Choice sub- 
jects and the subjects yoked to the Minimizers were low on stable at- 
tributions, and those subjects yoked to the Maximizers were high on sta- 
ble attributions, especially for failure. As might be expected, then, 
subjects who did not have control over the problems they received (and 
so were not likely to attribute their performance to their choice of 
problems) and who received easy problems (and so were not likely to at- 
tribute failure to the difficulty of the problems) attributed failure 
to lack of ability more often than did subjects who were given hard 
problems or who chose their problems. 

Because there were significant differences between choice and 
yoked control subjects on three of the four LOC dimensions (stable/un- 
stable, internal/external, and self /other), and no significant main ef- 
fects for day, one might conclude that the attribution differences were 
due to initial differences between the subjects who were subsequently 
assigned to the two conditions rather than to the treatment itself. 
However, since the subjects in the choice group were randomly chosen, 
and the subjects in the yoked control group were closely matched to 
them, it seems unlikely that any systematic prior differences between 
subjects could account for these attribution differences. The first 
LOC measure was not administered until subjects had spent two days on 
the computer, and ii. may be that the experimental treatment had already 
influenced perceptions and attributions of choice and control to some 
extent. Although the changes in attributions over time were not signi- 
ficant, most of the changes that occurred were in the expected direc- 
tion, e.g., yoked control subjects decreased and choice subjects in- 
creased self attributions over time for failure; and the differences 
between the groups tended to increase over time. Those subjects who 
were more disengaged during the first five days on the computer attri- 
buted their failures more to lack of effort, althout;h tiiis attribution 
did not result in less disengagement on succeeding days. 
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The significant positive correlation between disengagement during 
the last five days and the self attributions on the third LOC adminis- 
tration for yoked control subjects also seems to be due to the positive 
correlation between disengagement and attributions to lack of effort; 
subjects who were more disengaged more often attributed their failure 
to lack of effort. It Is Important to note, however, that both of 
these correlations Involving lack of effort attributions were associ- 
ated only with the disengagement measures. Apparently, the engagement 
measures were not reciprocally (negatively) related to lack of effort 
attributions. 

For subjects In the choice group, the significant positive corre- 
lation (.48) between Internal/external dimension scores on the third 
administration success Items and disengagement on the last five Jays 
was almost entirely due to a positive correlation (.45) between disen- 
gagement and attributions for success to ability. There was no such 
relation between disengagement and the other component of the Internal/ 
external dimension — effort. Thus, choice group subjects who were high- 
est In disengagement tended to attribute their success more frequently 
to a factor that does not directly Involve engagement or disengagement 
behavior. I.e., ability, which (unlike effort) Is not an attribution to 
actual behavior. In contrast, the yoked control group showed a signi- 
ficant positive correlation between stable attributions and engagement 
(.49). Thus, the yoked control subjects who were more engaged In the 
computer task on the last five days attributed their success to their 
ability more often than the less engaged yoked control subjects. This 
ability-engagement correlation suggests that In noncholce situations, 
students who feel more competent In a learning task will become more 
Involved In It. 

The study yielded disappointingly little direct evidence of rela- 
tionships between LOC attributions and engagement or disengagement. 
Only two of the 16 correlations for the choice group and two for the 
yoked group were significant. It may be that the LOC-engagement rela- 
tionship differs for the various choice patterns and was obscured by 
the overall correlation. A moj:e Important factor may have been the low 
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variability in engagement and disengagement means, because this small 
range of scores makes it difficult to find substantial correlations be- 
tween engagement or disengagement and the LOG variables. The low vari- 
ability was probably caused by choosing subjects who were from the same 
school, and had similar teachers, achievement scores, ages, and ethnic 
backgrounds. 

Only one of the significant correlations was found for the first 
administration of the LOC measure (after 2 days on the computer); for 
subjects in the choice group, attributions for failure to controllable 
sources as opposed to random or predetermined ones were positively 
correlated (.54) with disengagement on the first five days, i.e., the 
more failure was believed to be controllable, the more diser ;>agement 
was shown. Analysis of the correlations between disengagement and the 
specific attributions within the control/no control dimension (i.e., 
effort, task difficulty as selected by the computer) suggested that 
this significant correlation between disengagement and control scores 
was mostly due to a positive correlation between attributions for fail- 
ure to lack of effort and disengagement for a subject. Thus, it seems 
easier to understand a subject's LOC attributions at the beginning of 
the computer task in terms of his attempts to explain his engagement 
and disengagement behavior rather than in terms of the LOC attributions 
influencing engagement. 

Overall, the relationship between LOC attributions and the choice 
and yoked control conditions was much as expected and tended to provide 
construct validity for the four LOC dimensions. If attributions to 
sources controllable by the self are regarded as desirable in them- 
selves, the choice treatment can be regarded as beneficial. However, 
there was little correlational evidence supporting the notion of a 
mediating effect of LOC attributions upon engagement and disengagement, 
though there were some suggestions of relations between effort and abil 
ity attributions (primarily to disengagement) and some indication that 
these relations might differ depending on the presence of choice in a 
learning situation. The differential correlations between specific at- 
tributions (e.g.» effort, ability) within LOC dimensions and engagement 
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and disengagement supports the contention by Weiner (1972) that it is 
important to specify the particular sources of control to which a sub- 
ject attributes his performance rather than the general category of 
such attributions such as internal/external. 

Summary 

This investigation showed how some educational variables of cur- 
rent interest to researchers can be studied in an experimfental setting. 
One of these variables was choice of curriculum difficulty levels, and 
comparisons between choice and nonchoice conditions indicated that the 
choice condition produced significantly higher engagement levels and 
lower academic performance. Apparently, the choice subjects were not 
learning as much from their lessons a? might be expected from their 
higher engagement levels. These findings suggest that educational var- 
iables other than student choice should be studied in order to identify 
those which can improve academic performance. Two variables that might 
affect academic performance are the reinforcement schedules used in the 
learning task, and the manner in which the curriculum is organized and 
presented to students. 

The distinct choice patterns found in this study may have impor- 
tant implications for classroom instruction. If these patterns are also 
observed in classroom situations, different instructional techniques for 
Maximizers and Minimizers might increase their academic performance. 
Research on how to optimize learning for Maximizers and Minimizers is 
needed to design such techniques. The results of the present study 
demonstrate the importance of conducting research to identify individual 
differences in learning styles and to discover how these differences can 
be used as a basis for improving academic motivation and achievement. 
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APPENDIX A 
CONTRACT WITH THE SCHOOL 



December 14, 1971 

Proposal ; To cooperate with Dr, Maurice Fisher and his associates at 
the Research and Development Center In Teaching of Stanford University 
In conducting a research study. The Effects of Choice Situations upon 
Maximizing Engagement in computer assisted instruction. 

(Refer to Study Proposal dated October 1971 for specifics on design and 
procedures. ) 

Conditions: The following conditions which pertain to the conduct of 
the study agreed upon by an Ad Hoc faculty committee, the Principal, 
and Dr. Fisher: 

1. Screening of pupils to be selected for the study shall be done 
using data from tests administered by the school in October. 
After selection, pupils may be tested by instruments selected 
by the Research Center to gather additional data on pupil skill 
levels. Screening will be done using fourth and fifth grade 
pupils. Third grade pupils may be used to complete the study 

N of 120. 

2. The entire costs and management of the study shall be borne by 
the Research and Development Center. 

3. The School will provide space in a room presently used by our 
counselor to accommodate (2) two teletype machines. The cost 
of relocating the counselor's telephone in our resource center 
and returning the phone to the counselor's room at the close 
of the study shall be borne by the Research and Development 
Center. 

4. Use of computer line and programs will be available to the 
staf^ cooperating in th? study at all times except between 
9:30 a.m. to 1:00 p.m. on days school is in session. The 

time may be programmed according to needs defined by the staff. 

5. Results of the research and interpretation of results shall be 
made available to the school staff. 

6. Adjustments that appear necessary during the course of the 
study shall be discussed at such times by Dr. Fiiiher and rep- 
resentatives of the R&D Center and staff participating in 
the study. Staff shall have decision making power over such 
adjustments. 
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If at any time the school professional staff finds cause to 
question the advisability of continuing the study, a meeting 
of parties identified in //6 above shall be set to discuss 
the nature of the concern. Staff may discontinue participa- 
tion in the study if they deem it either in conflict with 
school program and/or injurious to participating students. 

Stanford R&D Center will provide sufficient personnel and 
time to train school personnel in use of teletypes and com- 
puter programs* 

Stanford R&D Center staff will be available in the tele- 
type center from 8:30 a.m. through 1:30 p.m. on school days. 



47 



APPENDIX B 

CHRONOLOGICAL AGES AND ACHIEVEMENT TEST SCORES OF SUBJECTS 
IN THE CHOICE AND YOKED CONTROL GROUPS 

~ Choice Group Yoked Group 

Pair Initial Achievement Initial Achievement 

No. Age (Mos.) Scores (Adjusted) Age (Mos.) Scores (Adjusted) 



1 


123 


3.90 


122 


4.00 


2 


1X5 


4.00 


131 


4.10 


3 


126 


4.20 


145 


4.10 


4 


123 


4.00 


122 


4.10 


5 


117 


3.70 


126 


3.60 


6 


120 


3.00 


128 


3.00 


7 


117 


3.00 


123 


3.00 


8 


• 121 


3.20 


125 


2.60 




141 


3.20 


139 


3.60 


10 


130 


3.00 


128 


3.40 


11 


131 


3.60 


134 


4.10 


12 


131 


/..lO 


126 


4.10 


13 


130 


4.70 


127 


5.00 


]4 


142 


4.00 


138 


3.70 


15 


126 


2.60 


133 


3.00 


16 


138 


2.70 


134 


2.30 


17 


134 


3.90 


128 


3.90 


18 


134 


4.90 


137 


4.80 




117 


4.70 


136 


4.30 


X 


128.47 


3.71 


130.71 


3,72 




(10 yrs. 8 mos.) 




(10 yrs. 10 mos.) 




s.d. 


.72 yrs. 


.68 


.58 yrs. 


.70 
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APPENDIX C 

ETHNICITY AND CLASSROOM ASSIGNMENTS 
OF PAIRS OF SUBJECTS 



Number 






Classroom 


Ethnicity 




Code 


Match 


Identification 


Match 


1 




A 




Same 


Mexican— American 


Same 


2 




B 




Same 


Black 


Same 


3 


A 


& 


B 


Different 


Mexican *-Ame r lean 


Same 


4 


A 


& 


C 


Different 


Mexican— American 


Same 


5 




E 




Same 


Anslo & Black 


Different 


6 




E 




Same 


Mexican— Amerl ran & Rlark 


Different 


7 


B 


& 


E 


Different 


Mex i can— Ame r i can 


Same 


8 




B 




Same 


Mex i can— Ame r i can 


Same 


9 


A 


& 


C 


Different 


Mexi can— Ame r lean 


Same 


10 


A 


& 


D 


Different 


Black 


Same 


11 


A 


& 


D 


Different 


Mex 1 can- Ame r 1 can 


Same 


12 




C 




Same 


Mexican-American 


Same 


13 


C 


& 


D 


Different 


Mexican-American 


Same 


14 


C 


& 


D 


Different 


Mex 1 can- Ame r 1 can 


Same 


15 




D 




Same 


Mex 1 can- Ame r lean 


Same 


16 




D 




Same 


Black & Anglo 


Different 


17 




D 




Same 


Black & Mexican-American 


Different 


18 


C 


& 


D 


Different 


Mex 1 can- Ame r 1 can 


Same 


19 




C 




Same 


Black & Mex ican-Amer lean 


Different 
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APPENDIX D 
CATEGORY DEFINITIONS FOR THE ENGAGEMENT/ 
DISENGAGEMENT OBSERVATION INSTRUMENT 



Note: Only one occurrence of a behavior category was noted for each in- 
terval on the instrument; repeated or continuous behavior in a 
category was not marked more than once in any interval. 



Engagement 

1. EP : Eyes on Paper - Subject looks at the paper of the teletype 

printout. 

2. EP (T) : While looking at the paper, subject has a toy (finger pup- 

pet or slot machine) within his grasp. 

3. TK : Touches Keys - Subject touches key(s) of the teletype with 

fingers, etc. 

4. TK (T) : Touches key(s) with puppet. 

5. PC : Pulls Closer - Subject adjusts his plane of perception forward 

(towards the keys). In order for this movement to be counted, 
the subject must move forward and become stable at a new base 
line for at least 3 seconds. 

6. TP : Touches Paper - Subject touches the teletype paper. 

7. RS : Reads Silently - Subject appears to read the teletype printout 

by moving his lips without making any audible sounds • 

8. TS : Talks to Self - Subject makes audible noises perceived by the 

observer. These may be reading aloud or actually talking to 
himself about a problem solution. 

9. CF : Counts on Fingern - Subject counts on his fingers either 

silently or aloud. 

10. S : Surprise - Subject shows sudden change in behavior associated 
with intense verbal response to a problem. 



Disengagement 

1. LA : Looks Away - Subjects looks away from the paper emerging from 
the teletype either with his eyes or his head and neck. 
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2. LA (T) : Looks away to play with the toys. 

3. TA : Turns Away - Subject turns his torso away from the teletype. 

4. TA (T) : Turns away to play with the toy. 



ERIC 
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APPENDIX E 

EXPERIMENTAL PROCEDURES FOLLOWED BY THE OBSERVERS 



Experimental Group 

1. In classroom ; Ask children if they will agree to work on the ma 
chines for 15 days in a row. Explain that they will work arithmetic 
problems on the computer. 

2. At the beginning in the CAI Room : Tell the children they have con- 
trol over choices. They can "go on" or "st6p" and can choose harder, 
easier, or the same types of problems. 

3. ON THE FIRST DAY ; 

A. Tell the children what questions they will receive and show them 
these questions. Tell them to choose "y" after the first ques- 
tion because we want them to see what happens next. But, fol- 
lowing this first question, they can stop after any interval 
when the question appears again. 

B. Go through the other questions. Also, tell them about the time 
intervals for receiving the questions. 

C. Explain to them that they can tell how many total problems they 
answered correctly from looking at the numbers on the printout. 
Show these numbers to them as an example. 

D. Say, "Everyone starts at group 100. If you choose 'harder' at 
the beginning, the number goes up. Then, if you choose 'easier,' 
the number will go down. If you choose the 'same,' the number 
will stay the same." 

«» 

E. Time on the Machine — Tell them that they can work on the ma- 
chines up to 35 minutes per day. Be sure to say that they 
should not stop working because the other pupil has stopped. 

. . . "Your program is different from your classmate's. Do not 
stop just because your classmate stopped. Only stop when you 
want to." When they stop each day, ask them why they stopped. 
Record information on observation sheet. 

F. Toys — Say that they can play with the toys anytime they want 
to. Demonstrate the use of the slot machines, finger puppets, 
and string-on-mobile. 

G. Then, tell them about your job (no test or grade) and not to 
worry about the mirrors. 
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H. Children's responses after 15 minutes — After they have worked 
on the teletype for 15 minutes, ask them to type In "y" follow- 
ing, "Do you want more problems?" 

I. Typing errors — The children will most likely have problems 
typing In the answers for the first few days. Always be brief 
and to the point when giving directions In order to encourage 
the emergence of Independent work on the teletypes. Tell them 
to type In the answers "just like you write them on paper." 
Horizontal problems, left to right; vertical problems, right 
to left. 

J. At the end of the first day , check to see If the children can 
read their group numbers and number of problems correct on the 
printouts. 

4. At the beginning of the 2nd and 3rd days, say, "Remember, you can 
*stop' or 'go on' when you get the tlrst question — you decide whe- 
ther you want to 'stop* or 'go on*. Do you understand?" 

5. Beginning of day three : 

A. Administer Form II of the Locus of ContrDl test to the subjects 
In this group. 

B. After they have worked on the machines for 5 more days, readmln- 
Ister the Locus of Control test. 

C. Then, the subjects will continue for another 8 days (total time 
on the machine « 15 days). Then they will be Interviewed fol- 
lowing the completion of their computer work. 



Yoked Control Group 

1. In classroom : Ask children If they will agree to work on the ma- 
chines for 15 days In a row. Explain that they will work arithmetic 
problems on the computer. 

2. ON THE FIRST DAY : 

A. Explain to th^m that they can tell how many total problems they 
answered correctly from looking at the numbers on their print- 
out. Show these numbers to them as an example. 

B. Say, "Everyone starts at group 100. Sometimes the problems will 
go to a higher group number, and then a lower group number. 
Sometimes the numbers will stay the same as they were before." 

C. Timeop the Machine — Tell them that the machine will run up 
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a maximum of 35 minutes per day. The teletype will sign off 
v;hen it is finished with the daily lesson. They must work the 
full time that the machine is running. 

♦ 

D. Say that the machine will "chatter" for about a minute after 
they have worked on the problems for different amounts of time. 
Then it will present new problems. 

E. Toys ~ Say that they can play with the toys anytime they want 
to. Demonstrate the use of the slot machines, finger puppets, 
and string-on-mobile. 

F. Then, tell them about your job (no test or grade) and not to 
worry about the mirrors. 

G. Typing errors — The children will most likely have problems 
typing in answers for the first few days. Always be brief and 
to the point when giving directions in order to encourage the 
emergence of independent work on the teletypes. Tell them to 
type in the answers "just like you write them on paper." Hori- 
zontal problems, left to right; vertical problems, right to 
left. 

H. At the end of the first day , check to see if the children can 
read their group numbers and number of problems correct on the 
printouts. 

Beginning of day three ; 

A. Administer Form I of the Locus of Control test to the subjects 
in this group. 

B. After they have woirked on the machines for 5 more days, readmin- 
ister the Locus of Control test. 

C. Then, the subjects will continue for another 8 days (total time 
on the machine * 15 days). They will be interviewed following 
the completion of their computer work. 
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APPENDIX F 
LOCUS OF CONTROL MEASURE 

Note: The form shown here is the one given to choice group subjects. 
On the yoked control subjects' form, the statement "I didn't 
ask for the right problems" is replaced by "I didn't let the 
computer give me the right problems," and "I asked for the 
right problems" is replaced by "I let the computer give me 
the right problems." 

1. If I do well on my computer lesson, it is because 
I tried hard. 

I'm good at math. 

2. If I don't do well on my computer lesson, it is because 
I didn't ask for the right problems. 

The computer didn't give me the right problems. 

3. When I finish a computer math problem quickly, it is because 

The computer gave me just the right problems. 

Just good luck, I guess. 

4. When it takes me a long time to do a computer math problem, it is 
because 

I didn't try hard enough 

Just bad luck, I guess 

5. When I finish a computer math problem quickly, it is because 
I'm good at math. 

The computer gave me just the right problems. 

6. If I don't do well on my computer lesson, it is because 
I didn't try hard enough. 

The computer didn't give me the right problems. 

7. When I finish a computer math problem quickly, it is because 
I'm good at math. 

Just good luck, I guess. 

8. When it takes me a long time to do a computer math problem, it is 
because 

____ The computer didn't give me the right problems. 
Just bad luck, I guess. 
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9. If I do well on my computer lesson, it is because 

I tried hard. 

Just good luck, I guess, 

10, If I don't do well on my computer lesson, it is because 
I*m just not very good at math, 

The computer didn't give me the right problems, 

11, If I do well on my computer lesson, it is because 

The computer gave me just the right problems, 
Just good luck, I guess, 

12, When it takes me a long time to do a computer math problem, it is 
because 

I didn't ask for the right problems, 

The computer didn't give me the right problems. 



13, If I do well on ray computer lesson, it is because 

I asked for the right probleras. 

The computer gave me the right problems. 

lA, When it takes me a long time to do a computer math problem, it is 
because 

Just bad luck, I guess, 

I'm just not very good at math. 



15, When I finish a computer math problem quickly, it is because 
I tried hard, 

I'm good at math, 

16, If I don't do well on my computer lesson, it is because 

The computer didn't give me the right problems, 

Just bad luck, I guess, 

17, If I do well on my computer lesson, it is because 

I'm good at math, 
The computer gave me just the right problems, 

18, If I don't do well on my computer lesson, it is because 
I didn't try hard enough, 

Just bad luck» I guess, 

19, When I finish a computer math problem quickly, it is because 
^ I asked for the right problems. 

The computer gave me the right problems. 
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20. When It takes me a long time to do a computer math problem^ It Is 
because 

I didn't try hard enough, 

The computer didn't give me the right problems. 



21. When I finish a computer math problem quickly > It Is because 
I tried hard. 

Just good luck, I guess. 

22. When It takes me a long time to do a computer math lesson, It Is 
because 

I'm just not very good at math. 

The computer didn't give me the right problems. 



23. If I do well on my comrttter lesson. It Is because 
Just good luck, I guess. 

I'm good at math. 

24. If I don't do well on my computer lesson. It Is because 
I'm just not very good at math. 

Just bad luck, I guess, 

25. If I do well, on my computer lesson. It Is because 
I tried hard. 

The computer gave me just the right problems. 

26. When It takes me a long time to do a computer math problem. It Is 
because 

I didn't try hard enough. 

I'm just not very good at math. 



27. When I finish a computer math problem quickly. It Is because 
I tried hard. 

The computer gave me just the right problems. 

28. If I don't do well on my computer lesson. It Is because 
I didn't try hard enough. 

I'm just not very good at math. 
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APPENDIX G 

RELIABILITY OF THE LOCUS OF CONTROL MEASURE 



The LOC instrument was constructed using two parallel stems; an es- 
timate of the internal consistency reliability for the instrument was 
obtained by comparing the responses to the two stems. In April 1973 
the LOC measure was administered to a group of 21 students from the 
school where the study was done. These students were ineligible for the 
experiment since they all had previous CAI experience. All of them re- 
ceived the yoked form of the instrument on two separate occasions, two 
days apart. The internal consistency analysis was done separately for 
each administration of the instrument; results were then averaged. Re- 
sponses to the two stems were considerably more consistent on the sec- 
ond administration than on the first (Table G-1). 

Each pair of items containing different stems and the same response 
alternatives were examined. The two responses for each pair were tal- 
lied as either the same or different, and the percentage of the same re- 
sponses was calculated for the whole instrument, for success and failure 
pairs of items separately, and for those pairs of items in each of the 
four LOC dimensions within success and failure categories. The results 
are shown in Table G-1. 



TABLE G-1 



Percentage of the Same Responses 



Item Categories" 


First 
Administration 


Second 
Administration 


Mean 

% 


Total 


74% 


82% 


78 


Success 


76 


84 


80 


Self /other 


76 


74 


75 


Internal/External 


75 


88 


81.5 


Control/No Control 


75 


88 


81.5 


Stable/Unstable 


76 


89 


82.5 


Failure 


71 


80 


75.5 


Self/Other 


/4 


83 


78.5 


Internal/External 


68 


74 


71 


Control/No Control 


73 


79 


76 


Stable/Unstable 


71 


89 


79 
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In a second analysis, the instrument was divided in half by the two 
stems, and the appropriate items within each half were used to obtain 
scores on each of the four dimensions. The two scores (one for stem 7 
and one for stem 2) were then recorded as the same or different, and 
the percentage of the same scores was calculated for all four dimensions 
for both success and failure. The results are shown in Table 0-2. 



TABLE G-2 
Percentage of the Same Scores 



First Second Mean 
Item Categories Administration Administration % 



Success 



Self/Other 62% 52% 57 

Internal/External 33 71 52 

Control/No Control 38 76 57 

Stable/Unstable A8 86 67 



Failure 



Self/Other 67 67 67 

Internal/ External 29 A3 36 

Control/No Control 43 52 47.5 

Stable/Unstable 67 81 74 



Finally, Pearson product moment correlations were calculated be- 
tween the scores for stem 1 and the scores for stem 2 for success and 
failure items in all four dimensions (separately). The Spearman-Brown 
formula was then applied to these correlations; the resulting estimates 
of internal consistency are showri in Table G-3. 
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TABLE G-3 
Internal Consistency Reliability 



First Second Mean 
Item Categories Administration Administration % 



Success 

Self /Other .18 .48 .33 

Internal/External .77 .93 .85 

Control/No Control .80 .87 .835 

Stable/Unstable .88 .98 .93 

Failure 

Self /Other .69 .82 .755 

Internal/External .63 .85 .74 

Control/No Control .78 .87 .825 

Stable/Unstable .83 .96 .895 
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APPENDIX H 

SUMMARY TABLES FOR LOCUS OF CONTROL DATA 



TABLE H-1 

Summary of Analysis of Variance of Difference Scores 
on the LOC S«-able/Unstable Dimension 



Source 


Sum of 
Squares 


Degrees of 
Freedom 


Mean 
Square 


F 


Treatment 


51.453 


1 


51.453 


24.93* 


Choice Pattern 


35.822 


2 


17.911 


8.68* 


Pairs within Choire Pattern 


32.973 


16 


2.064 




Type of Score 


1.048 


1 


1.048 


0.240 


Type of Score x Choice Pattern 


23.641 


2 


11.821 


2.708 


TvDe of Score x Pairs within 
Choice Pattern 


69.833 


16 


4.365 




Day 


1.405 


2 


.702 


.136 


Day X Choice Pattern 


5.141 


4 


1.285 


.248 


Day X Pairs within Choice 
Pattern 


165.587 


32 


5.175 




Type of Score x Day 


3.697 


2 


1.849 


.229 


Type X Date x Day x Choice 
Pattern 


10.675 


4 


2.669 


.331 


Type X Date x Pairs within 
Choice Pattern 


258.362 


32 


8.074 





*p < .05 



TABLE H-2 



Summary of Analysis of Variance of Differenqe Scores on the 
LOG Internal/External Dimension 



Source 


Sum of 
Squares 


Degrees of 
Freedom 


Mean 
Square 


F 


Treatment 


58-008 


1 


58.088 


8.704* 


Choice Pattern 


31.478 


2 


15.739 


O O C Q 


Pairs within Choice Pattern 


107.911 


1 a 

ID 


D . D /H 




Type of Score 


187 


1 


.187 


.061 


Type of Score x Choice Pattern 


91.599 i. 


2 


45.799 


14.904* 


Type of Score x Pairs within 
Choice Pattern 


49.172. 


16 


3.073 





Day 


6.170 


2 


3.085 


.218 


Hav V Choirp Pattern 


6.999 


4 


1.750 


.124 


Day X Pairs within Choice 
Pattern 


451.859 


32 


14.121 




Type of Score x Day 


6.657 


2 


3.329 


.52 


Type of Score x Day x Choice 
Pattern 


4.491 


4 


1.123 


.176 


Type of Score x Day x Pairs 
within Choice Pattern 


204.447 


32 


6.388 





*p < .05 
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TABLE H-3 

Summary of Analysis of Variance of Difference Scores 
on the LOG Control/No Control Dimension 



Source 


Sum of 
Squares 


Degrees of 
Freedom 


Mean 
Square 


F 


Treatment 


17.846 


1 


17.846 


2.63 


Choice Pattern 


24.109 


2 


12.054 


1.778 


Pairs within Choice Pattern 


108.519 


16 


6.78 




iype or Dcore 


1 ^01 


1 
1 




• ZUD 


Type of Score x Choice Pattern 


.712 


2 


.356 


.048 


Type of Score x Pairs within 
Choice Patt^.rn 


119.097 


16 


7.444 




Day 


1 /. Q 0 


O 

Z 


7/. 1 


.Uo!> 


Day X Choice Pattern 


26.115 


4 


6.529 


752 


Day X Pairs within Choice 
Pattern 


277.941 


32 


8.686 




Type of Score x Day 


9.308 


2 


4.654 


.754 


Type of Score x Day x Choice 
Pattern 


21.489 


4 


5.372 


.871 


Type of Score x Day x Pairs 
within Choice Pattern 


197.521 


32 


6.17 
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TABLE H-4 



Suininary of Analysis of Variance of Difference 
Scores on the LOG Self Dimension 



Source 


Sura of 
Squares 


Degrees of 
Freedom 


Mean 
Sc^uare 


F 


Treatment 


25.427 


1 


25.427 


6.352* 


Choice Pattern 


25.765 


2 


12.882 


3.218 


Pairs within Choice Pattern 


64.041 


16 


4.003 





Type of Score 


2.820 


1 


2.820 


1,064 


Type of Score x Choice Pattern 


14. 356 


2 


T O T O 
7*2/0 


Z . /4i 


Type of Score x Pairs within 
Choice Pattern 


42.478 


16 


0 /TCP 

2.655 




Day 


13.642 


2 


6.821 


1.565 


Day X Choice Pattern 


17.788 


4 


4.447 


1.020 


Day X Pairs within Choice 
Pattern 


139.453 


32 


4.358 




Type of Score x Day 


8.558 


2 


4.279 


2.152 


Type of Score x Day x Choice 
Pattern 


.889 


4 


.222 


.112 


Type of Score x Day x Pairs 
within Choice Patterns 


63.600 


32 


1.988 





*p < .05 



